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10.1.0 Basic Concepts 

In real-life applications, we are often interested in multiple observations of random values over a period of time. For example, suppose that you 
are observing the stock price of a company over the next few months. In particular, let S(t ) be the stock price at time t E [ 0 , oo). Here, we 
assume t = 0 refers to current time. Figure 10.1 shows a possible outcome of this random experiment from time t — 0 to time t = 1 . 
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Figure 10.1 - A possible realization of values of a stock observed as a function of time. Here, S (t) is an example of a random 

process. 

Note that at any fixed time t\ E [0, oo), S(t\ ) is a random variable. Based on your knowledge of finance and the historical data, you might 
be able to provide a PDF for S (t \). If you choose another time £2 £ [0, oo), you obtain another random variable S (£2 ) that could 
potentially have a different PDF. When we consider the values of S(t) for t E [0, oo) collectively, we say S(t ) is a random process or a 
stochastic process. We may show this process by 

{s(t),t € [0,oo)}. 

Therefore, a random process is a collection of random variables usually indexed by time (or sometimes by space). 

A random process is a collection of random variables usually indexed by time. 

The process S (t) mentioned here is an example of a continuous-time random process. In general, when we have a random process X(t) 
where t can take real values in an interval on the real line, then X(t) is a continuous-time random process. Here are a few more examples of 
continuous-time random processes: 

— Let N (t) be the number of customers who have visited a bank from t = 9 (when the bank opens at 9:00 am) until time t , on a 
given day, for t E [9,16]. Here, we measure t in hours, but t can take any real value between 9 and 16. We assume that iV(9) = 0, 
and iV(t) E {0, 1,2,...} for all t E [9, 16] . Note that for any time t\ , the random variable N (t\ ) is a discrete random variable. 
Thus, N (t) is a discrete-valued random process. However, since t can take any real value between 9 and 16, iV(t) is a continuous¬ 
time random process. 

— Let W (t) be the thermal noise voltage generated across a resistor in an electric circuit at time t, for t E [0, oo). Here, W (t) can 
take real values. 

— Let T(t) be the temperature in New York City at time t E [0, oo). We can assume here that t is measured in hours and t = 0 
refers to the time we start measuring the temperature. 

In all of these examples, we are dealing with an uncountable number of random variables. For example, for any given t\ E [9,16], N(t \) 
is a random variable. Thus, the random process N (t) consists of an uncountable number of random variables. A random process can be 
defined on the entire real line, i.e., t E (—QO,Oo).In fact, it is sometimes convenient to assume that the process starts at t = —OO even if 
we are interested in X(t) only on a finite interval. For example, we can assume that the T(t) defined above is a random process defined for 
all t E M. although we get to observe only a finite portion of it. 

On the other hand, you can have a discrete-time random process. A discrete-time random process is a process 

{x(t),te J}, 

where J is a countable set. Since J is countable, we can write J = {t\ , £2 > * * *}• We usually define X(t n ) = X(jl) or x(t n ) = x n , 
for 71 = 1, 2, • • *, (the index values 71 could be from any countable set such as N or 7L). Therefore, a discrete-time random process is just a 
sequence of random variables. For this reason, discrete-time random processes are sometimes referred to as random sequences. We can denote 
such a discrete-time process as 

{X(n),n = 0,1,2,...} or {X n ,n = 0,1,2,...}. 

Or, if the process is defined for all integers, then we may show the process by 

{X(n),n € Z} or {l„,n £ Z}. 

Here is an example of a discrete-time random process. Suppose that we are observing customers who visit a bank starting at a given time. Let 
x n for 71 E N be the amount of time the ith customer spends at the bank. This process consists of a countable number of random variables 

x u x 2 ,x 3 ,... 

Thus, we say that the process { X n , 71 — 1,2, 3..} is a discrete-time random process. Discrete-time processes are sometimes obtained from 
continuous-time processes by discretizing time (sampling at specific times). For example, if you only record the temperature in New York City 
once a day (let's say at noon), then you can define a process 

X\ = T(12) (temperature at noon on day 1, t = 12) 

X 2 = T(36) (temperature at noon on day 2, t = 12 + 24) 

X 3 = T(60) (temperature at noon on day 3, t = 12 + 24 + 24) 


And, in general, X n = T(t n ) where t n = 24(n — 1) + 12 for 71 E N. Here, X n is a discrete-time random process. Figure 10.2 
shows a possible realization of this random process. 
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Figure 10.2 - Possible realization of the random process { Xn > ^ 1 > 2 j 3, • • ■ } where X n shows the temperature in New 

York City at noon on day 71. 

A continuous-time random process is a random process { X(t), t G J |. where J is an interval on the real line such as [ — 1,1], [0,Oo), 
( —OO, oo), etc. 

A discrete-time random process (or a random sequence) is a random process { X (ti) - X n ,71 G J |, where J is a countable set such as 
N orZ. 


Random Processes as Random Functions: 
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Consider a random process | X(t ), t G J j. This random process is resulted from a random experiment, e.g., observing the stock prices of a 
company over a period of time. Remember that any random experiment is defined on a sample space S . After observing the values of X(t), 
we obtain a function of time such as the one showed in Fig ure 10.1 . The function shown in this figure is just one of the many possible 
outcomes of this random experiment. We call each of these possible functions of X(t) a sample function or sample path. It is also called a 
realization of X(t). 

From this point of view, a random process can be thought of as a random function of time. You are familiar with the concept of functions. The 
difference here is that { X(t) ,f E J} will be equal to one of many possible sample functions after we are done with our random 
experiment. In engineering applications, random processes are often referred to as random signals. 

A random process is a random function of time. 


Example 10.1 

You have 1000 dollars to put in an account with interest rate R, compounded annually. That is, if X n is the value of the account at year Tl, 
then 


X n = 1000(1 + R) n , for n = 0 , 1 , 2 ,- 

The value of R is a random variable that is determined when you put the money in the bank, but it does not not change after that. In particular, 
assume that R ~ Uniform^ 0.04,0.05). 

a. Find all possible sample functions for the random process {X n , Tl — 0,1,2,...}. 

b. Find the expected value of your account at year three. That is, find £'[^ 3 ]. 


• Solution 

o a. Here, the randomness in X n comes from the random variable R. As soon as you know R, you know the entire sequence 
X n for Tl = 0,1, 2, • • *. In particular, if R = T, then 

X n = 1000(1 + r) n , for all n G {0,1, 2, • • •}. 

Thus, here sample functions are of the form f(n) = 1000(1 + 7*) n , Tl = 0,1, 2, • • •, where T G [0.04, 0.05]. For 
any V G [0.04, 0.05], you obtain a sample function for the random process X n . 
b. The random variable X 3 is given by 


X 3 - 1000(1 + R) 3 . 

If you let Y = 1 + R, thenV ~ Uniform(1.0A, 1.05), so 



To obtain E{X; 5 ] , we can write 


1.04 < y < 1.05 
otherwise 


..04 


e[x 3 ] = iooou[y 3 ] 

/ 1.05 

10 5 

~ ~ 4 ~ 

10 s 

“ ~T~ 

« 1,141.2 


100y 3 d y 


1.05 

1.04 
4 


(1.05) 4 - (1.04) 4 


(by LOTUS) 


Example 10.2 

Let {X(f), t £ [0, 00 ) } be defined as 

X(t) = A + Bt , for all t G [0, oo), 

where A and B are independent normal iV(l, 1) random variables, 
a. Find all possible sample functions for this random process. 
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b. Define the random variable Y = X(l) . Find the PDF ofY. 

c. Let also Z = X(2). Find E [Y Z]. 

• Solution 

o a. Here, we note that the randomness in X{t) comes from the two random variables A and B. The random variable A can 

take any real value a G R.. The random variable B can also take any real value b G R. As soon as we know the values of 
A and B, the entire process X(t) is known. In particular, if A = a and B = b, then 

X(t) = a + bt, for all t € [0, oo). 

Thus, here, sample functions are of the form /(f) = a + bt , t > 0, where a, b € R, For any a, b € M you obtain a 
sample function for the random process X(t). 
b. We have 


Y = X(l) = A + B. 

Since A and B are independent 7V(1,1) random variables, Y = A + B is also normal with 

EY = E[A + B] 

= E[A\ + E\B\ 

= 1 + 1 

= 2 , 


Var(y) = Var (A + B) 

= Var(yl) + Var(B) (since A and B are independent) 
= 1 + 1 
= 2 . 


Thus, we conclude that Y ~ N (2, 2): 


c. We have 


fy(y) = 



E[YZ] = E[(A + B)(A + 2 B)\ 

= E[A 2 +3AB + 2B 2 } 

= E[A 2 } + 3E[AB\ + 2E[B 2 } 

= 2 + 2>E[A]E\B\ + 2-2 (since A and B are independent) 
= 9. 


The random processes in the above examples were relatively simple in the sense that the randomness in the process originated from one or two 
random variables. We will see more complicated examples later on. 

<— previous 
next —» 
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